Exponential Bounds for Random Sums. 

MiGDASHIEV B.M.^ OSTROVSKY E.I."* ^ ^ 
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, Abstract. We construct a non - improved exponential bounds for distribution of normed sums of 

(N ■ 

■ i.ji.d. random variables with random numbers of summand. 
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1. Introduction. 

Oh ' 

Let {Q, F, fi) be a probability space, {^{i)}, ^ = 1, 2, ... be a sequence 
! of independent identical distributed (i; i.d) centered: E^(i) = random 

variables (r.v) with finite non - trivial variance cr^ = D^(^) G (0, oo), and 
let ?7, ?7 > 1 be an integer r.v. with finite first moment E?7 = ^4, where 
> ; ^4 G [2, oo). We assume at first that the r.v. 77 and the sequence {^{i)} 

^ ■ are independent. 

We will denote for arbitrary r.v. r and x = const > the tail function 

r(r,x) = max(P(r > x),P(r < -x)). 



will write for the r.v. ^(1) R{x) = T{^{l),x), and we define the so 
called normed random sum and corresponding uniform tail function 



H ■ i=l 

V{x) = V{Law{r]), Law{^{i))^ x) = sup T{S, x). 

A>2 

In the case if the r.v. 77 — 1 has a Poisson distribution Pois{A) with 
parameter A : P(r/ — 1 = n) = ^4"^ exp(— 74)/?7,!, n = 0,1,2,... and 
Law{r] — 1) G UA>2{Pois{A)} we will write V{Pois; Law{^{i)), x) = 
V{UA>2{Pois{A)}, Law{^{i)), x); if the r.v. 77 has a geometrical dis- 
tribution G{A) : P(r/ = n) = A~\l - 1/A)''~\n = 1,2,..., A > 
2 and Law{r]) G Ua>2{G{A)} we will write V{G; Law{^{i)), x) = 
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V{Ua>2{G{A)}, Law {^{i)),x); for the case of alMistribution r.v. 77 under 
the condition that E77 = A, 3A > 2 we wih use the notations corre- 
spondently Dis{A), Dis = UA>2{Dis{A)} and V{Dis,Law{^{i)),x) = 
V{UA>2{{Dis{A)},Law{^{i)),x). 

Our goal is the bide - side exponential estimating V{x) at 
X — ^ 00, X >2 in the terms of distributions Law{^{i)), Law{rf). 

We have for all distribution ^{i) under the conditions E^(i) = 
0, D^(i) G (0, 00), since E^(i) = 0, D^(i) G (0, 00) : 

V{Dis^ Law{iE,{i))tX) < min 

by virtue of Chebyshev inequality; this estimation is called trivial. 

There are many publications about the moment estimations El^l^ 
and statistical applications of those estimations (see, for example, (Gut 
A., 1988), (Gut A., 2003): 

\S\p<B{p) Ir/lf 1^(1)1,, p>2, (0) 

where B{p) is a constant in the famous Burkholder inequality for mar- 
tingales. Here and further for arbitrary r.v. C, 

|C|p = E'*|c|'' = ||CIMaP). 

It is proved in (Hitczenko, 1990) that the best boundary for B{p) sX p> 
2, p ^ 00 is B[p) <Cp/ logp, C is an absolute constant. Note that the 
estimation (0) is proved in the case if r.v. r] is the stopping time for the 
sequence {^(^)}, for example, if Vn = 1,2,... r.v.'s ^(1), ^(2), . . . , ^(n) 
and the event {77 = n} are independent. 

See also (Gine at al., 2003) etc. For non - random sums, i.e. in the 
case P(?7 = n) = 1 for some n = 1,2,... the exponential bounds for 
V{x) are constructed in (Buldygin at al., 1992), (Ostrovsky, 1999, p. 
28); for more generally case if {^{i)} are the martingale - differences the 
exponential bound for T{S,x) is derived in (Lesign at al., 2001). 

For reader convenience we recall here some results of (Buldygin at al, 
1992), (Lesign at al., 2001). Let us define for some tail function T(x), i.e. 
for the function T = T(x) under the conditions: T(0) = 1, T{oo) = 0, 
monotonically non - increasing and right continuous with finite second 
moment | Jq^ x'^ dT{x) \ < 00 the operator 

W[T\{x) = min(^l,4inf 



exp(-xV(8^^) - / x'^ dT{x) 

J z 
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Further, put 

ip{X) = maxlogEexp(±A^(i)). 

This definition is non - trivial only if the variable .^(1) satisfies the so - 
called Kramer condition: 

3Ao e (0, oo), VA e (-Ao, Aq) =^ (f{X) < oo; 

in other case we set (p{X) = (X) VA 7^ 0. 

Let us introduce the function x(A) = sup„=i 2,...^</^(VV^)5 

X*{x) = sup(Ax - x(A)), 

A 

Q[R]{x) = mm{W[R]{x),exp{-x*{x))}. 
Lemma 1. (Buldygin at al., 1992), (Lesign at al., 2001). 

supT (n-^^^p^^ii), < Q[R\ix), x>0. (1) 

Let us introduce the Orlicz spaces G(m, r) (in order to describe the 
examples) of random variables as the set of all r.v. {r} with finite norm 

||r|k. = sup|r|,p-V- log^Mp. 

p>2 

Here m = const > 0, r = const G i?^. It is easy to verify that G{m, r) 
is isomorphic to the Orlicz space with N— function 

N{u) = exp (l^r log" |u|) , |u| > 2, 

and that r E G(m, r) if and only if 

T{t,x) < exp(-Ci(m,r)a;"'log"(C2(m,r) +a;)). (2) 

See (Buldygin at al, 1992, p.351). 

For example, assume that the r.v. r has Poisson distribution with 
parameter A; A > 2. Then for some non - trivial positive absolute 
constants Ci, C2 and all p^x > 2 

\t-A\p < Ci V^p/logp, 

or 

P(|t - A\/VA > x) < exp {-C2X \ogx) . 
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Let us suppose, for example, that for some m = const >0,rG-R^^(l)G 
G{m, r). We define the following functions M = M{m, r), L = L{m, r) : 
at m G (0, 1) or m = 1, r < ^ M = 2m/ {m + 2), L = 2r/(m + 2); 
at m = 1, r > or m G (1, 2), r < ^ M = m, L = r; at m = 2, r > 
orm>2 ^M = 2,L = 0. We can define formally in the case m 
■ X. rGi?^M = 2, L = 0. 
It follows from (1) 

supT (^E e(0/v^, ^ < exp (-C3 log^(C2 + x)) , (3) 
C2,3 = C'2,3(m,r), or, equally, 

n 

sup 1 1 E v^l \m,l < C(m, r) 1 1^(1) | U,,. 

n>l i=l 

It is proved in (Ostrovsky, 1999, p. 34) that in the case m > 1 the 
estimation (2) is exact at x — ^ oo. 

In this paper, the letter C, Cj{-) will denote positive finite various non 
- essentially constant which may differ from one formula to the next and 
which does not depend upon x, n. We make no attempt to obtain the best 
values for these constants. 

2. Main result. Upper bound. Examples. 

Theorem 1. 

V{Law{r]),Law{^{i)),r],x) < E Q[R\{a x^/A/^). (4) 

Proof. We will assume without loss of generality (7 = 1. We receive 
from (1), using the formula of full probability and denoting g„ = qn{A) = 
P(77 = n) : V{x) = 

P f E (ii) > ^v^) = E QnP (t miV^ > x^^A/^ < 

\i=l J n=l \i=l / 

Y.qn Q[R]{x4A/n) = E Q[R]{x^). 

n 

Example 1. Let us suppose here that the r.v. r] has a geometric distribu- 
tion G{A) with parameter A, A>2, and that 3m > 0,3r e R L{^{1)) e 
G{m, r). We assert that at x > 2 =^ sup^>2 V{G{A), G{m, r),x) < 

Cs{m, r) exp (-C(m, r)x'''/^^+'^ (logx)2V(M+2)) 
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=^ J{M,L;x) = J{x). 



Proof. We have using theorem 1: 



V{GiA), G(m, r),x)<^iA- ly' exp(n[log(l - 1/A)]~ 

n=l 



Cx"" n-^I^A^I^n-^l\\og''{C2 + x^fAfa)) <{A- 1)-^ x 



Ci E exp {-C{nlA + x^(^/n)^/2(log^(C2 + xy^)) =^ 

n=2 ^ ^ 



oo 



We denote 



E a(n; 

n=2 



A^o = -^0(^5 ^) = argmax a(n; A,x) = A uq^x), 

n>2 

where at x ^ 00 =^ 

No/ A ~ C2(M, L) ^2^/(^+2) (logx)'^/^^+') . 

Since the function n a{n; A, x) is monotonic in the intervales [1, A^o] 
and [Nq, 00), we can estimate 

C2 (A-l) V{G,G{m,r),x) < 
/"exp (-C [{y/A) + log^(C2 + x ^))) (iy = 



Cs^ r exp (-C - x^z-^/^ log^(C2 + x/v^) )) dz < 



C3 A r exp (-C(z - log^(C2 + ^/^^)) dz. 

J 



/fOO 


Let us denote (3 = 2M/(2 + M), 



i;) = + (2/M) i;-^'^/^ log^ (C2 + x'"'^'^^''^ v'^''') 



U{x,v) = v + (2/M)i;-^/2 logL^^ x>2,v>0; 



S{x, v) =x^{v + (2/M)i;-^/2 log^ (C2 + x'/^^+%-'/')) . 

Let A = A(M, L) be the arbitrary function on M,L so that 
A > 2\L\/{M + 2). After the substitution z = x^ v we receive: 
sup^>2y(G(A),G(m,r),Cix)/C2 < 

Cx^ r exp i-S{x, v)) dv =^ I{M, L; x) = I{x). 
We have / = x^{Ii + /2 + /s), where 

1 -A 1 A 

rlog X flog X roo 



flOg X riog X roo 

h = j^ , /2 = /3 = y^^^,^ exp(-5(x, v)) dv. 

Since at G (0, log"^ x) U (log^^ x, log^^ x)) ^ 



S{x,v)=x^R{x,v) > CzU{Cax,v) > Cx'^\og^+^^/^ x, 
we conclude 

h < \og-^x- exp (-Cx^ log^+^^/^a;) < C5 J(M, L; Cgx); 
0:^/2 < (log^ x^ exp — C min U{x,v)\ < 

\ {velog~^ a;,log^ a;} / 

C7J{M,N;C8x). Further, 

x'^ h < Ha exp i-x^ v) dv < C9 J(M, N; Ciqx). 

ilog a; ^ ^ 

Following, G(m, r), x) < Cii(m, r)x 

exp (-Ci2(m, r)x2^/(^+2) (logx)'^/^^^')) , x > 2. (5) 
On the other hand 



sup ||'S'||2M/(M+2), 2L/(M+2) < C'e] | |m,r- 

A>2 
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Example 2. Let us now suppose again that L{^{i)} G G{m,r) for some 
m > 0, r G -R and assume that the r.v. rj — 1 has a Poisson distribution 
with parameter B = A — 1; A > 2. It follows from theorem 1 and 
Stirling's formula that V{Pois{A), G{m, r),x) < 

oo 

C sup exp(— B + nlogB — logn! — 

B>ln=l 

Cx^5^/V^/2(log^(C2 + x/BAl))) < 

00 

C sup exp(— 5 — nlogn+ 

B>ln=l 

n - Cx^B^/'n-^/\\og\C2 + x^B/n)) < 

oo 

C J2 supexp(— B — nlogn + n— 

n=lB>l 

Cx^5^/2n-^/2(log^(C2 + x^fB/^)). (6) 

It is easy to verify that the maximum of arbitrary member of the right 
- side (6) over 5 > 1 for sufficiently greater values x > xq, xq = const > 
2 is achieved at 5 = 1. Therefore V{Pois{A)^G{m,r)^x)/C < 

00 

< E exp (-1 - nlogn + n - Cx^n-^/^ log^(C2 + . 

n=2 

Since for x > 2 

E exp(— n log n + n) < exp (^—Cx^ log , 

we have: 

V{Pois{A), G{m,r), x)/C < exp(-CxMogx) + 

E exp (n - n logn - Cx^n'^/^ log^(C2 + x/V^)) . 

Let us denote A^i = Ni(x) = 

argmax (n — n logn — Gx^n~^^^ log'^(C2 + x/ y/n)) ; 

ne[l,a;2] 
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it is easy to calculate: 

We obtain for values x >2 : 

V{Pois^ G{m^ r)^x)/C{m^ r) < exp (— Cx^ log a;) + 

(x^ + 1) exp (iVi - iVi log iVi - Cx^N[^^^ log^(C2 + x/VK)) < 

Cs exp (-C(m, r)x'''/^^+'^ (log:z:)(2^+^)/(^+^)) . (7) 

In the case m = oo, i.e. if the variable ^(1) is bounded {mod P), then 
2M/(M + 2) = 1, (2L + M)/(M + 2) = 1/2. 

We can rewrite (7) in the considered case Law{r] — 1) = 
Pois, Law{^{i) £ G{m^r) in the terms of G{m^r) spaces: 

SUp||S'||2M/(M+2), (M+2L)/(M+2) < C {m,r)\\i{l)\\m,r- 

In the case if Law{^{i)} G Um>i{G(m, r)} the estimation (7) improves 
some result of (Gine at al, 2003). For instance, if m G (l,oo), r = 0, 
then from (7) it follows the inequality: p > 2 ^ 

sup \S\p < Ci p^/2+i/^""^("^'2VyiogP, P > 2, 

A>2 

but we receive from (Gine at all, 2003): 

sup|5|p<C2P^+^/"^/logp, 

A>2 

and we obtain from (Gut, 1988), (Gut, 2003): 

sup l^l^ < Cs log-'/' p. 

A>2 

3. Low bounds. We will prove further that our estimations are non 
- improved in general case, for example, even for normal distribution of 
values {^{i)}. 

Theorem 2. We assert that for all values m > 1 and sufficiently 
larges x,x > xq = const > 2 : V{G, G{m, r),x) > 

C6(m, r) exp [-C,im, r)^^^/^^^^) (log :^) 2^(^+2)) , (g) 
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V{Pois,G{m,r),x) > 

Cs{m, r) exp {-Cg{m, t)x^^I^^+^) (logx)(2^+^)/(^+2)>) . (9) 

Proof is very simple. It is enought to prove the inequality (8); the 
proposition (9) is proved analogously. Let ^(z) be independent symmet- 
rically distributed r.v. with distributions 

P(|^(z)| >x)= exp (-x™ [log(C(m, r) + x)Y) , x > 0, 

and let us introduce the even smooth convex function (^^^^(A) = 
log E exp(A^(z)), A G (—00,00). It is proved in (Buldygin at al., 1992, 
p.341), (Ostrovsky, 1999, p.34) that 

Cl¥?m,r(A) < V'm,r(A) < C2(/?m,r(A) , 

where V^m,r(A) = A^A G [-2,2]; 

V'm,r(A) = C3|Ar/(-^) [log(C4 + |A|)]-^/(-l) 

in the case |A| > 2. Since the r.v. are i., i.d., we have for the non 

- random sum: 

log E exp I^An"^/^ = rupm,M/\/n) x 

^V^m,r(A/ Vn)? where the symbol x is understood uniformly on n; AG 

R: 

(\ ^ n ( \ ^ ■ f ■ f nifmA^/V^) / 
< Gi(m, r) < mt mt — , ' ^ , ^, < 

n>l \€R m/jm,r{^/ y/n) 

sup sup — ■ — < 62(772, r) < 00. 

n>i Aei? nipmA^I \/n) 

We conclude at x > 2, A>2: 

00 / n 

n=l \i=l 

We deduce, choosing again in this sum only the member with n = Nq 
(recall that Nq = Nq(x)) and using the main result of paper (Bagdasarov 
at al, 1995): 

P f n-i/' E e(i) >u\> exp {-Cm^ log^(C2 + u)) , 



where Ci, C2 = Ci(m, r), C2(m, r); u = u(n) > 2 : 

P(5 >x)>{A- - l/Af^-P ( E > > 

CeM exp (-C7(m)a;2^/(^+2) [iog:^]2V(M+2)^) _ 
Theorem 3. For all values x > 3 

y (Dzs, iv(o, 1), x) > c x-l (10) 

Here A/'(0, 1) denotes the normal distribution with parameters 0, 1; and 
C is an absolute constant. 

Proof. We suppose now L{^{i)) = N{0, 1), i.e. 



P(^(i) >x) = ^(x) = (27r)-V2 r expi-yy2)dy. 

Jx 



fOO 
IX 
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We define a = l/£^n^[x ], Ent[z\ denotes the integer part of z, for x > 3 
and choose the r.v. 77 by the following way: P(77 = 2) = 1 — P(77 = 
1/a) = a. Then ^ = E77 = 3 - 2a > 25/9 > 2; 

P(5' > a;) > aP (e ^(0 > ^V^j = 



(1/M) * [x^J?> - 2/[xVV[2^']j > ^" * (3V3/8j = C:r-^ 

4. Upper exponential bound for stopping time. In this section 
we will obtain the exponential bounds for the tails of distribution r.v. S 
in the case if r] is the stopping time for the sequence {^(^)}, in addition 
to the moment estimations of S in (Gut, 1988), (Gut, 2003). Recall that 
again ES* = and = 1. 

Theorem 4. Assume that the r.v. rj belong to the space G{m,r) 
for some m>0, rG-R: 77G G{m, r) and is the stopping time for the 
sequence {^(^)}, where ^{\) G G(a, 6), a = const > 0, 6 = const : Vx > 2 

T(7y, x) < exp (-C x"" log^ x) , T{r], x) < exp (-C a;" log^ a;) . 
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Denote 

2am 2arm + mb + 2am 

q = , w = . 

2am + 2a + m 2am + 2a + m 

We assert that at x >2 

sup sup r(5', x) < exp (—C(a, 6, m, r)x^ log^ x) . (11) 

A>2 r]:'Er]=A 

Proof of theorem 4. It follows from our conditions and the theory 
of G — spaces (2) that for all p >2 

m)\p < Cip'/'" log-^/-p, \r]\p < C^p"'' log-^/>. 
We obtain using the inequality (0) with optimal constant B[p) : 

The last inequality is equivalent to (11), see (2). 
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